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Abstract —It is well known that, in general, feedback may 
enlarge the capacity region of Gaussian broadcast channels. This 
has been demonstrated even when the feedback is noisy (or 
partial-but-perfect) and only from one of the receivers. The only 
case known where feedback has been shown not to enlarge the 
capacity region is when the channel is physically degraded. In this 
paper, we show that for a class of two-user Gaussian broadcast 
channels (not necessarily physically degraded), passively feeding 
back the stronger user’s signal over a link corrupted by Gaussian 
noise does not enlarge the capacity region if the variance of 
feedback noise is above a certain threshold. 

I. Introduction 

It is well known that feedback does not increase the capacity 
of a memoryless point-to-point channel, a result which goes 
back to C. E. Shannon [1], However, feedback has a positive 
impact in simplifying coding schemes and boosting error 
exponents [2], With the discovery of capacity regions for 
several multiuser models in the ’70s and ’80s, it was of interest 
to find the impact of feedback in these models. For the discrete 
memoryless broadcast channel (BC), El Gamal [3] showed 
that feedback does not enlarge the capacity region when the 
channel is physically degraded, and Dueck [4] demonstrated a 
broadcast channel for which points outside its capacity region 
can be attained using feedback. 

For a two-user scalar Gaussian broadcast channel (GBC), 
El Gamal [5] showed that the capacity region is unchanged 
by the presence of noiseless feedback, if one of the receivers 
is physically degraded with respect to the other. However, 
Ozarow and Leung [6] showed the surprising fact that the GBC 
capacity region is enlarged by feedback for a class of positively 
correlated noise processes at the receivers. The technique 
of [6] used full causal feedback from both the receivers. Re¬ 
cently it was shown that even perfect causal feedback from one 
of the receivers can enlarge the GBC capacity region [7]. In 
other related works, it was shown that the capacity enlargement 
can occur for the discrete memoryless broadcast channel even 
when the feedback is noisy [8], [9], or rate-limited [10], [11], 
The GBC case was also considered in [9] and [11]. For the 
Gaussian multiple-access channel (MAC), it is known that 
noisy feedback, even to only one of the transmitters, always 
enlarges the capacity region [12]. Moreover, a duality has been 
shown between linear coding schemes for MAC and BC in the 
presence of noiseless feedback [13]. Thus, in general, there is 
an optimism about the availability of feedback enlarging the 


capacity region of broadcast channels when the channel is not 
physically degraded. 

Against this backdrop, the purpose of this paper is to 
show that the anticipated capacity enlargement may not exist 
for all feedback models over a GBC. We show that, for a 
class of two-user scalar GBCs, when the stronger receiver’s 
signal (i.e., the signal of the receiver with the smaller noise 
variance) is passively fed back to the transmitter over a noisy 
link corrupted by independent Gaussian noise, any capacity 
enlargement is impossible if the feedback noise variance is 
above a certain threshold. Our class of channels is, in fact, 
the same as that studied by Ozarow and Leung [6] where they 
showed that the capacity region is enlarged by perfect feedback 
from both receivers. This class includes independent noises at 
the two users as well as a range of positive correlations. 

We also study a related class of vector GBCs with partial- 
but-perfect feedback. Specifically, consider a vector GBC 
with a strong receiver employing two receive antennas and 
the other receiver and encoder only having single antennas. 
In the absence of feedback, the optimal scheme is super¬ 
position coding, along with maximal ratio combining at the 
strong receiver. Now, assume that the weak user has a higher 
noise variance with respect to the first antenna of the strong 
receiver. Then, we will show that even perfectly feeding back 
the second antenna output from the strong receiver does not 
enlarge the capacity region. 

The organization of this paper is as follows. In the next sec¬ 
tion, we will describe the broadcast channel and the feedback 
model. This will be followed by our main result in Section III, 
which shows that feedback from the stronger user does not 
enlarge the capacity region if the feedback noise variance is 
above a certain threshold for a class of Gaussian noise models. 
A Gaussian BC with two antennas at the strong receiver and 
perfect feedback from one of the antennas will be considered 
in Section IV. Section V concludes the paper. 

II. System Model 

Consider a memoryless two-user scalar Gaussian broadcast 
channel, where receiver 1 is the stronger receiver (i.e., its noise 
variance is not larger than the noise variance of the other user). 
Assume a noisy feedback link from the strong receiver to the 
transmitter, as shown in Figure 1. 
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Fig. 1. Scalar Gaussian broadcast channel with noisy feedback (causal) 


In this model, X represents the transmitted signal. The 
additive (forward) channel noises Z\, Z 2 are zero-mean jointly 
Gaussian with variances of,c r 2 , respectively, and correlation 
coefficient p. As mentioned above, we will take erf < erf. 
The additive noise on the feedback channel Z fb is assumed 
to be independent of {Z\,Z 2 ) and zero-mean Gaussian with 
variance af b . In this setup, we aim to send two independent 
messages, say ITT and IT' 2 , to the respective receivers. The 
transmitted symbol at the i th instant can be a function of the 
messages and the causal but noisy feedback of the stronger 
user’s signal, i.e., 

Xi = 9i(WuW 2 , Yt 1 + Zfh 1 ), ( 1 ) 

where the symbol (7 l_1 = (Ui, ■ • ■ , Ui- 1 ). We will convey a 
pair of messages in n uses of the channel, and the alphabet 
sizes of Wi,W 2 are 2 nRl and 2 nH ' 2 , respectively. Consider 
the average probability of error over a uniform choice of the 
messages, which we denote by P e (n). We are interested in 
the capacity region C s n b ° ( ! 5y fb of our model under an average 
transmit power constraint of P. 

Definition 1. The capacity region C" b ' sy fb is the closure of 
the set of all rate-pairs (f?i, R 2 ) such that there is a sequence 
of encoder-decoders with P e (n) —> 0 as n -A 00 . 

Let C“7 fb denote the capacity region without feedback. 
Clearly, 

/-wo—fb /^noisy—fb 

'■'sbe — ^sbe 

The region (’7° fb is a well known quantity, which can be 
achieved by superposition coding [14]. 

III. Feedback Noise Variance Thresholds 

Our main result establishes a threshold for the feedback 
noise variance beyond which the feedback from stronger user 
does not enlarge the capacity region for a class of forward 
noise correlations (including independent and physically de¬ 
graded cases). 

Theorem 1. For 0 < p < < 1, C 5 n ° l i sy_fb = C s w b °" fb 



Fig. 2. Theorem 1 guarantees that for independent forward channel noises, 
noisy feedback from the stronger user does not enlarge the capacity region 
when the noise variances fall in the shaded region. 



( 2 ) 


Notice that, when p = y 7 , the broadcast channel is 
physically degraded and the feedback noise variance threshold 
in (2) is 0. This is already implied by El Gamal’s result [5]. 
At the other extreme, when the forward channel noises are 
independent {p = 0), the result is as shown in Fig. 2. 
However, note that the theorem does not give a threshold for 
all positively correlated Z\, Z 2 . For example, when Z 2 = 22j, 
we have 1 = p > = h, and Theorem 1 does not 

apply. More specifically, the theorem above gives a threshold 
whenever we can write Zi,Z 2 as (3)-(4), where Z,Zi,Z 2 
are independent. This is also the class of channels studied by 
Ozarow and Leung [6], 

Proof: We start by noting that when of < of and p < 
-y, without loss of generality, we may write Z\, Z 2 in the 
form 


Zi = Z + Zi (3) 

Z 2 = Z + Z 2 , (4) 

where Z. Z \, Z> are independent zero-mean Gaussian random 
variables with variances respectively, given by 

? 2 = p^jofof 

4 = <*1- P\J a i <7 2 

2 2 / o o 

?2 = a 2 ~ P\l G \°2- 

The key idea of the proof is to give receiver 1 access to 
the feedback noise (step (a) below). By Fano’s inequality. 





(6) 


(suppressing an ne term) 

nRi^I{WY,Y?\W 2 ) 

< I{Wi\Y?,Z? h \W 2 ) 

n 

= ^2 i (w 1 -,Y li \ w 2 , Y t 1 ,z;~ 1 ) 

i =1 
n 

= Y}(Yu\W 2 ,YtlZ^~ 1 ) - hiYulW^W^YtlZ^ 1 ) 

i =1 
(b) n 

< Y KYu\W 2 , Yt 1 - aZ^ 1 ) - h(Z li ) 

i =1 
n 

= Y HYulW^X*-^ Z l - X Y ZY- aZ f Y) - h(Z u ), 

i =1 

where in (b) we used the fact that Xi is a function of 
(W 1 , W 2 , yY,Z^). We choose a = || so that Zi - aZ fb 
is independent of Zi+Z^. This choice ensures that Z\ -aZf b 
is independent of Z\ + = Z + Z\ + Zf\ 2 . Notice that 

(i) Xi is a function only of everything the encoder knows 
before time instant i, namely, ( W\ , W 2 , Z^ 1 + Z^f 1 ), and (ii) 
both Z\ ~ 1 — aZY 1 and Z 2 ~ 1 are independent of encoder’s 
knowledge (Wi, W 2 , Z^ 1 + Z^f 1 ) before time instant i. Now, 
if Var(Zi — aZfb) < Var(Z 2 ), for each i, then we can write 1 

HYulW^X*- 1 + Z*- 1 + Z {- 1 - a^ 1 ) 

< h(Yu\W 2 ,X i ~ 1 + Z 4 " 1 + Zt 1 ). 


<^log2ne(P + al)-h(Y 2 n \W 2 ). 

where the last inequality follows (via concavity of log) from 
the power constraint and the memorylessness of the channel. 
We can relate the first term of (5) and the second term above 
through the entropy power inequality (EPI). 

Lemma 2. 

2 W* \w 2 ) > 2 S £?=i HY^Wirf- 1 ) + 27re ( cr 2 _ a 2y (7) 


The proof, which is along the lines of El Gamal [5, Lemma 
1] and Blachman [15], is given in the appendix. 

To finish the proof, we note that 


log 2ite(P + cr 2 ) > h(Y 2 n ) > h(Y 2 n \W 2 ) > h(Z?), 

where the last inequality follows from h(Yf\W 2 ) = 

£?=r h{Y 2i \W 2 ,Yt l ) < EtiHY^XuW^Yt 1 ) = 

h(Z 2 ). Hence, there is some 9 £ [0,1] such that 

-h(Y 2 n \W 2 ) = 7 -log 2Tre(9P + cr 2 ). 
n 2 

Substituting in ( 6 ), we get 


R 2 < ^ log 



(1 -0)P \ 

9P + a 2 ) 


Furthermore, (5) and (7) will imply. 


R \ < 2 lo § 



It is easy to verify that the condition Var(Zi — aZ fb) < 
Var(Z 2 ) is precisely ( 2 ). Substituting back, we have 

nR\ < (j^hiYii^iY^ 1 )^ - ^ log 27recr]\ (5) 

By Fano’s inequality, 

nf? 2 «/(W 2 ;F 2 ”) 

= h(Y 2 n ) - h{Y 2 \W 2 ) 

n 

<Y h ( Y *i) ~ h ( Y 2 n \ W l) 

i=1 

l To see this, let us write Z 2 = Z 2 a +Z 2 &, where Z 2 a, % 2 b are independent 
and also independent of everything else. Let Var(Z 2 a ) = Var(Zi — aZ^). 
Then, we may write 

WYulW^X*- 1 + Z *” 1 + Zj ” 1 - aZ 1 - 1 ) 

< h(Yu\W 2i X i ~ 1 + Z*” 1 + Z*- 1 ), 

since the independence of (Zj —1 — aZ^* 1 ) and everything the encoder has 
access to before time instant i allows us to replace Zj —1 — aZf b —1 by any 
other memoryless Gaussian random vector (Z^” 1 in our case) with the same 
variance and which is also independent of encoder’s knowledge before time i. 
Now, using the fact that Z^ 1 is independent of everything else, we have 

HYu^x 1 - 1 + z*- 1 + Z 1 ^ 1 ) 

= HYu^x *- 1 +Z *- 1 +zi~ 1 ,z 1 - 1 ) 

< h(Yu\W2, X* -1 + Z i_1 + Z 2 ~ X + Z^ 1 ). 


Thus, we have shown that (Ri,R 2 ) £ and the proof 

is complete. ■ 

Theorem 1 can also be extended to more generalized feed¬ 
back settings with additive Gaussian noise where the feedback 
noise may not be independent of the forward channel noises. 
This extension will be considered in a longer version of this 
paper. 


IV. Vector Broadcast Channel with Feedback 


It may appear that the additive Gaussian noise in the 
feedback plays a critical role in the negative result that we 
presented in the last section. In this section we study a vector 
GBC where the signal from one of the antennas will be fed 
back perfectly , but this still does not enlarge the capacity 
region in certain settings as we will describe below. 

Let us consider the two-user memoryless broadcast channel 
shown in Figure 3 below, where user 1 makes two independent 
observations (Yn,Yi 2 ) of each transmitted symbol. User 2 
observes a scalar output Y 2 . For simplicity, we will assume that 
the noises on different antennas are independent. Specifically, 
let Z = ( Z 2 . Z\ i, Z| 2 ) be a zero mean Gaussian random 
vector with a diagonal covariance matrix 


K z = 


0 


'ii 


0 

0 

^12 


Let us assume that the output symbols Y\ 2 are perfectly fed 
back to the transmitter (causally). Notice that Yu as well as Y 2 




Fig. 3. A vector Gaussian broadcast channel with feedback 


are not fed back. Let £P^ tlal ~ fb anc | C™ b ° c T fb denote the feedback 
and no-feedback capacity regions. 

We study the case where a 2 1 < a 2 , i.e., the second receiver 
has a larger noise variance than the noise variance at the 
antenna of the first receiver that is not fed back. Under this 
assumption, we will show that perfect causal feedback of 
Yi 2 does not enlarge the capacity region. Notice that the 
‘no enlargement’ result holds good irrespective of the link 
quality of Y\ 2 . This is surprising, since we are feeding back a 
major portion of the output to receiver 1 , particularly so when 
a i 2 < a ii- We now state our main theorem. 

Theorem 3. C^ c rtia| - fc = C&* if a 2 , < of. 

The proof is along the same lines as that of Theorem 1 
presented in the last section. 

Proof: Recall that the boundary of the no-feedback ca¬ 
pacity region C™ c ~ fb is given by 


R i<\ lo S 

R 2 < ^ log 


^1 + OP 




(i -Q)p \ 

ep + al) 



for 9 G [0,1]. This is just the capacity region of the scalar 
broadcast channel resulting from receiver 1 pre-processing Yu 
and Y 12 by passing it through a maximal ratio combiner. 

By Fano’s inequality. 


nR 2 » /(W 2 ; Yf) 

= h(Y ?) - h(Y 2 n \W 2 ) 

TL 

< — lo g 7 re(P + a 2 ) — h(Yf\W 2 ). 
We know that there exists some 9 € [0,1] such that 
h(Y 2 n \W 2 ) = ^\og27re(9P + al). 

Thus, 


R 2 < - log 



(1 ~ 0 )P \ 
OP + a 2 J' 


( 8 ) 

(9) 

( 10 ) 


( 11 ) 


Let us now consider the rates for receiver 1. We will write 
(Yu,Yi 2 ) as Yi, and let Y" denote the 2 x n matrix of 
received values at receiver 1. Again, by Fano’s inequality 


nR\ 


I(W i; Y?\W 2 ) 

n 

^2l(W 1 -,Y lti \W 2 ,Y i 1 ~ 1 ). 

i =1 


( 12 ) 

(13) 


Let -K = -4—I—4- and consider the following invertible 

fe /’ll Jp2 6 

transformation of V i. 




1 • 

+1 


Y = 


Y + Z e 


where Z e = a 2 ( is independent of Zf. Note that 

V ^ll <J 12 / 

Z e ~ A''(0. a 2 ) is an independent identically distributed (i.i.d.) 

2 2 

process with E [Z e Z\f\ = ■ Since the Zf process is 

G 1 l~r‘ T 12 

i.i.d. and independent of the Z, process, we can write, 

n 

^IiWuY^lW^YT 1 ) 

i=1 

n 

= ^ h {Ye,i\ W 2, Y^” 1 ) ^ h ( Z e,i) 

i= 1 
(a) n 

< Y Mn,i|w 2 , 14 V 1 ) - 

i=1 
n 

= Y h ( x + z e,iiw 2 , Yfr 1 ) - h(z e>i ), 

where in step (a) we removed Yff 1 from the conditioning to 
obtain the inequality. Since Y 2 has a larger noise variance than 
Yu (i.e., a\ > ah) and both of them are not fed back to the 
transmitter, we may write (also see footnote 1) 

n 

nR\ < Y K x i + Z eyi \Yt\W 2 ) - h(Z eii ). (14) 

i-1 

Consider an i.i.d. process Zd ~ Af(0,a 2 — a 2 ), independent 
of all other processes mentioned before. Using El Gamal’s 
version of EPI [5, Lemma 1], 

2 ££? =1 < 2n h ( Y P+ z d\W 2 ) _ 27re((J 2 _ 

= 2^4*1^) - 27re(tr| - a 2 e ) 

= 2ne(9P + af) — 2'ne{a\ — a 2 ) 

= 27t e(9P + a 2 )- 


Collecting all these together, we have 

Pi < f log ^1 + . (15) 

This completes our converse, and we have shown whenever 
of < a 2 , perfect causal feedback from the antenna Yi 2 does 
not change the capacity region of our broadcast channel. ■ 
While we have assumed independent noise processes at the 
antennas, this can be extended to the case where the noises 
may be correlated. In fact. Theorem 1 can be obtained as a 
corollary of such a generalization. 




V. Conclusion 

We presented a class of two-user scalar Gaussian broadcast 
channels with passive noisy feedback from one of the receivers 
for which feedback does not enlarge the capacity region. 
Our result is in the form of a threshold on the feedback 
noise variance above which feedback cannot achieve points 
outside the no-feedback capacity region. We also saw a class 
of two-user vector Gaussian broadcast channels where perfect 
feedback of some components of the received signal from a 
user does not lead to an enlarged capacity region. 

Our study raises the question whether the threshold in 
Theorem 1 is tight, i.e., is there a coding scheme which 
can achieve points outside the no-feedback capacity region 
whenever the feedback noise variance is below our threshold 
(and also in all cases where Theorem 1 does not apply). 

It must be emphasized that we only considered passive 
feedback. With active feedback schemes no such thresholds 
may exist, e.g., one simple way to get around the limitation is 
to conserve power on the feedback link and use it only every 
so often (or equivalently, to send only a subsampled version of 
the received signal, but repeat each sample several times) so 
that the effective noise variance on the feedback link is below 
our threshold. This suggests that it is unlikely that there are 
any such thresholds for active feedback schemes with a noisy 
link. The same comment applies to rate-limited feedback [11], 

Acknowledgements 

This research was supported in part by Information Technol¬ 
ogy Research Academy (ITRA), Government of India under 
ITRA-Mobile grant ITRA/15(64)/Mobile/USEAADWN/01. 
SRBP’s research was also supported by the Department of Sci¬ 
ence & Technology (DST) India grant SB/S3/EECE/077/2013. 
VP’s research was partially supported by a Ramanujan Fellow¬ 
ship from the Department of Science & Technology, Govern¬ 
ment of India. 

References 

[1] C. E. Shannon, “The zero-error capacity of a noisy channel,” IRE 
Transactions on Information Theory , vol. 19, 1956. 

[2] A. El Gamal and Y.-H. Kim, Network Information Theory. Cambridge 
University Press, 2011. 

[3] A. El Gamal, “The feedback capacity of degraded broadcast channels,” 
IEEE Transactions on Information Theory , vol. IT-24, pp. 379-381, 
1978. 

[4] G. Dueck, “Partial feedback for two-way and broadcast channels,” 
Information and Control, vol. 46, no. 1, pp. 1-15, 1980. 

[5] A. El Gamal, “The capacity of the physically degraded Gaussian 
broadcast channel with feedback (corresp.),” IEEE Transactions on 
Information Theory, vol. 27, no. 4, pp. 508-511, Jul 1981. 

[6] L. H. Ozarow and S. K. Leung-Yan-Cheong, “An achievable region and 
outer bound for the Gaussian broadcast channel with feedback,” IEEE 
Transactions on Information Theory , vol. IT-30, pp. 667-671, 1984. 

[7] S. R. Bhaskaran, “Gaussian BC with feedback,” IEEE Transactions on 
Information Theory, pp. 5252-5257, Aug 2008. 

[8] O. Shayevitz and M. Wigger, “On the capacity of the discrete memory¬ 
less broadcast channel with feedback,” IEEE Transactions on Informa¬ 
tion Theory, vol. 59, no. 3, pp. 1329-1345, Mar 2013. 

[9] R. Venkataramanan and S. Pradhan, “An achievable rate region for the 
broadcast channel with feedback,” IEEE Transactions on Information 
Theory, vol. 59, no. 10, pp. 6175-6191, Oct 2013. 


[10] Y. Wu and M. Wigger, “Any positive feedback rate increases the capacity 
of strictly less-noisy broadcast channels,” in Proc. of Information Theory 
Workshop (ITW) 2013, pp. 1-5, Sept 2013. 

[11] -, “Coding schemes for discrete memory less broadcast channels with 

rate-limited feedback,” CoRR, vol. abs/1401.6219, 2014. 

[12] A. Lapidoth and M. Wigger, “On the AWGN MAC with imperfect 
feedback,” IEEE Transactions on Information Theory, vol. 56, no. 11, 
pp. 5432-5476, Nov 2010. 

[13] B. Amor, Y. Steinberg, and M. Wigger, “MIMO MAC-BC duality with 
linear-feedback coding schemes,” CoRR, vol. abs/1404.2584, 2014. 

[14] T. M. Cover and J. A. Thomas, Elements of Information Theory. Wiley, 
1991. 

[15] N. M. Blachman, “The convolution inequality for entropy powers,” IEEE 
Transactions on Information Theory, vol. 11, no. 2, pp. 267-271, Apr 
1965. 

Appendix 

Proof of Lemma 2: 

We prove this by induction on n. For n = 1, the inequality 
follows from entropy power inequality [2, pg. 22] since we 
may write 

h(Y 2! t\W 2 ) = h(Y 1A + Z' 2 'i\W 2 ), 

where Z 2 , is zero-mean Gaussian with 
Var {Z’ 21 ) =a\-a\ 

and independent of everything else. This simply follows from 
the fact that (Z\ t i, Z 2 t i) is independent of (W 2 ,Xi). and 

Var(^i i i) = af < a 2 = Var(Z 2 j i). 

Suppose (7) is true for n = m — 1. We may write 
h(Y 2m \(W 2 ,Y 2 m - 1 )) = h(Y lm + 
where Z 2m is zero-mean Gaussian with 
Var(^ m ) =a\-a\ 

and independent of everything else. This follows from the 
fact that (Zim, i? 2 m) is independent of (W 2 , Y™~ ,X m ) and 
Var(Zi m ) < Var(i? 2 m ). By (conditional) entropy power 
inequality [2, pg. 22], 

22h{Y 2m \W 2 ,Y™- 1 ) > 2^h{y\m\W 2 ,Yf- 1 ) + 2^ h ( z 2 ) _ 

i.e., 

2 h(Y 2 m\W 2 , Y™- 1 ) > log + 27r -e(of - a? 

So, 

— h(Y 2 m \W 2 ) 
m 

= m ~ l 2 + -h{Y2m\W2 1 Yf n - 1 ) 

m m — 1 m 

> — log ( 2 ^ & HYu\W 2 ,Yt>) + 27re( 2 _ a 2 X 

m V / 

+ 1 log (2 2 ^l Wi.r?- 1 ) + 2ne(a 2 - a 2 )) 

> log (2* EE- MVi.l"^- 1 ) + 2ire(cr 2 a 2 )) . 

where (a) follows from the induction hypothesis and the EPI 
above, and (b) follows from convexity of log(2“ + v) in u for 

v > 0. ■ 



